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This instrument-is designed to establish a standard 
by which te determine the needs and effectiveness of vccatsonal 
education prcgrams in Alaska. Section 1, The Evaluation, identifies 


some preevaluation decisions, cutlines the eight-ster, 
self-evaluaticn process, provides guidelines for individuals 


_participatine in the evaluaticn process, and discusses how to rate 


the criteria ccntained in the evaluaticn instrument. Section 2° 
contains the instrukent, which consists if sixteen criteria organized 
in€@fcur categories: personnel (instructional, guidance and - 
counseling, end administrative staff), support services (advisory 
committees, financing, and in-school resources), management 
*(evaluation, placement, planning systers, and public relations), and 
curriculus (articulation, cgoperative educationswork experience, 
delivery etratedies, inservice, needs cf special students, and 
student leadership development). The third section provides. the 
format ard instructions far develoring from the evaluation 
information a cumulative report that includes program strengthb, 
areas for improvement, and reccemmendations. A brief glossary is” 
appended. (YIE) . — 
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ss INTRODUCTION ’ 
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\ ee The Alaska State Department of Education under. the direction of the 
=: 3 Commissfoner has been committed to-the development and utilization of 


apprepriate procedures for .comt inuous planning and evaluation. Through 
the State Plan for Vocational Education, ‘the SPAN Plan and other efforts, 
. a the Qepartment has established the foundations of program development. 
rr > PrCngEnEHI Ng: OF Ene | assessment component of program planning is a- “ATgh” 
«9 priority” currently ‘Being addressed vous a contract to the ‘Southcentral 
BES Resource Center. ‘ 
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This instrument was devéloped by the. Vocational Education PROGRAM. 


EVALUATION Tsk FORCE _(PETF) whose membership included leading vocational’ ; 


educators ‘in, the State of Alaska. AS part of the dévelopment, pilot- 
testing was. conducted within school districts representative of “Alaskan 
education. Additionally, ’ this instrument | will, be presented to the State + 
Board of Education for approval. ; : , 
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- The purpose ‘of the document ‘is to assist local educators in the 

“process of SELF- ENALUATION and is intended to be readily usable’ by ° 
instructors. administrators and lay personnel in determining the ‘needs 
and effectiveness of their Vocational rtegee program. 
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Pre-Evaluation Decisions 
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How to Rate the Criteria 
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PREEVALUATION DECISTONS* 


' 1 aia Before proceeding any Further with this instrument there are several 
Eee; 1SSUCS you need to confront. These issues were identified by those who 

Mi. field tested the instrument and felt’ that decisions must be made at this ig 

Ba, Stage.of the evaluation rather’ than later. 


e Do you,have a need for which this self-evaluation instroment would 2a ae ay 


a - 
1 


. “~If your product, the vocational student outcomes, is meeting your . a ee 
“expectations, your standard, probabl not. While any program has room’. /% .° * 
™ for improvement, the patential gains may not be worth the cost of , - 


BAYS 'evaluation if you are gatisfied that the studente are succeeding. © | 


WY 


‘estrengths, areas needing improvement , suggestions, and information 5. - ~~ 

’ R fe ; Ww 1 . P . = : / 
wikFor assistance in evaluating the success of the vocational education 

program, in terms of student outcomes, see: . 3 
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This instrument was designed to establish a standard by which to eee 
determine the elements that may be included in an exemplary voca- ae 
tional’ education program in Alaska. These standards were identified ie 
by vocational educators with extensive experience in both rural and ~ om 
urban Alaskan ‘education. : . 


The instrument is NOT intended to evaluate the effectiveness of a 
personnel] - teachers, administrators, paraprofessionals or students. 
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© Will the instrument be usable in a- small school or district? De as 
YES. This document is meant to be adapted to meet‘ local needs. 
hile, on one hand, the instrument presents standards with which 
a vocdtional program may be compared, it does not pretend to repre- - 
sent the entire range of creative alternatives that may be employed ‘ : 
‘ : in’ the small or remote program. An important component of each ’ 
ee section of this instrument is, the Additional Indicators. The purpose 
wah Fo of this component of the evaluation is for your program to identify 
Ae those creative elements which havé been used to solve unusual problems. 
Ree. _ The indicators specified for each criteria are suggested only and, 
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mee: (This instrument is. intended to act as a foundation for a total eva]ua- 
ae jan processiand allows for additions ‘and adaptations as you see fit. 
0 conduct the evaluation yourself but to use a 


' third-party approath 


Additionally, current ‘subject area guides to evaluation. have been 
developed in home economics and business education.» 
reconmended, as a complementary part of your total 
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mrepresent standard responses to general vocational education needs 
me Your additional indicators may meet oy 
Bere Pressed under each philosophy. 
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sIL should also be noted that aresponse of "NA! does n 
is being done to meet the objective specified by the 
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"surpass the objectives ex- 
- .Y 


philosophy. It 


means that that particular indicator does not apply in your 


However, the "Additional Indicators" that you write plus 


Be NM 2 
A team approach is recommended for the purpose of data gathering. 
R’ However, one person should be designated team leader. 
mM would be dssigned to making conta 
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: evaluation process? 


Ha You may tecide not t 


3 your program is meeting the ot 


wis Staff members who are re 


ne, developing summary statements. 


ts or procedures can 
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ze How much will this evaluation process cost? 
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cts with program components and 


In total, this evaluation process should take from two to thr 


conducting this evaluation will mostly be in the time of 
sponsible for completing the various compo-’, 
me. nents. If your vocational program is spead out oven several sites 
Reine you may need to travel to discover relevant information. 

ky add to the cost. 
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“those specified should complete requirements df the state philosophy. 
VThe "Summary Statement" should then give a complete picture of how we] ] 
ectives stated by the philosophy. 2000... - 


ot mean that nothing 
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be used to assist in the 
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. The directions allow for this: contingency. 
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eValuation process. 
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ese guides are 


? ee weeks | 
,to complete, depending on the size and complexity of your system. 
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PROCESS FOR SELF-EVALUATION 


ots, Now that you have made some pre- -evaluation decisions it is time to 
‘embark on the actual ale 
Rt: STEP 1. Administrative Approval ; 
bai Obtain administrative approval and support to assfre cooperation A ost Th 
eS with, and participation in, the evaluation proces It is re- PRA A 
“sy commended that yous) prepared by having documented the ae oh adeies edt gh 
© evaluation decision including: yo RR 
we A. Need for evaluat ion; on i ea - Sarr ay 
ede a ss : fe a SEs, Pe grams pies airy sgt’ ae ate : 
nee IEP Target of evaluation y. aoe Sho cat oa uae 
) 
as Applicability: of instrument to your system; ~ é 
-' "D0. Cost; and, 
<< E. Evaluation method and components. ) ? 
wm STEP 2, Responsibility ©. a 
Assign the responsibility of organizing and ecipieeant the — = 
evaluation. This-.may' Se done within the agency or POnEaGree to . , 
a resource center or ather consultant. ee = 7 Z 
STEP 3, Planning ~ a : a 
as | Decisions need to be made “4s to: a), the scope of the @valuation; .- ro 
Pv a b) participant selection; c) schedule of activities; d) whéther 
ca to validate the self-evaluation with a:third-party review; and, 
Rc ous 7 L e). butiget ing.” \ . > ‘ : . a a a a : 
RSG, i, . . \ _- , _ oo ; a * 
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F ; 
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ae The evaluation coordinator should explain purposes ant pro- 
Paging * . cedures to school personnel, advisory comnit tee members , ‘students, : 
salt Ast and others selected to participate. a re ee 
aoe STEP 5, Evaluation \ , oo? 4 
Mts ee 
ee « Participants complete the self-evaluation instrument. School ° : ‘ 
gage personnel should rate all criteria while other participants rate 
*, : only those criteria with which they are familiar. School staff 
. should rate all criteria. Advisory Committees should rate all 
: areas except Administrative Staff, Guidance -and Counsel png. Staff, = & y= 
ee, : Instructional Staff, Delivery Strategies and Inservice. Students va 
a see ‘should rate Guidance and Counseling, Instructional, Staff, Placement, 
y Articulation, Cooperative Education/Work Experience, Deliver Strat- ®% 9 
a ‘ egies, Needs fo Special Students and Vocational Student Leadership ‘ 
ae Wy Devel conene \ - 
ee os , a 4 
ode ae + ; : . eo ke : 
Awe ee x ’ ae ks ceqnith oe a Big ccis 
+ re -6- 2 - ae re | 
see He. . on * = _ 7 .  & ae = # wes ee # 3 2 Ae is See fel Ean of 
E ERICA ok may ~ da ets OS eat aah naa na meres oes s 9 aes ele pene ee 
. 4 ; a : . : tn’ 
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conclusions and recommendations. 
evaluation coordinator conducts a meeting during which the , 


The 


yi "22 team reaches concehsus on the conclusions and retonmendations. i 
oe 2. 8 4 . 
_ : . ‘ ; ‘ aoe 
mer STEP 7. Report Preparation . a oo mae 
oe ‘an a aes ee -. 4 a r . ce te Tete es ’ cere » stash 
.t 2 J o8 ‘ : ? x . . 7 a8 ag fm 
» .y + he self-evaluatton coordinator prepares a report containing woo woogie 
the results of the compilation meeting. If a third. party is /. 


aevy> Used for the evaluation the third party team leader WITT prepare: en caskehshee 
.. @ report. . 7 ; —— a — CON as 
. é Ee ‘ i te : J’ & - ue , = - ; : F ae . Yo \ 
Bette STEP 8. Utilization of Results “ e = 
ee -_ = 
The decisi regarding whether to follow-up ‘the self-evaluation 
with third-party validation affects the next step in utilization .« 
“+ of results. - 4 : ; 7 
ee" AL Self-evaluation only 
Teed 
is {": Soe ~ , . 
, The self-evaluation report is distributed to all concerned 
with the vocation program, the report is reviewed; areas 
3 needing attention are identified; and a plan for improvement, 
iP ke . is included in the annual and long-range planning. ee 
ae B. Self-evaluation with third-party validation. - 
“Adisbeg a a oo, 
ee . The self-evaluatiop report is distributed to participants. 
ned Copies are also provided to the third-party evaluatéon team. 
as The self-eva)uation, afd third-party evaluation reports are 2 
oe both considered in preparing a final evaluation report that : 
ae . is distributed to all concerned with, the vocation, program; an 
cs aaa ; the final report is reviewed, areas needing attention are ease 8 Se 
Asa identified; and a plan for improvement is included in lokal 
ee ee ; annual and long-range planning. a , 3 
core : 4 as ‘ 
a . 
. Aer ms - “ . , ui 
a ¢ v ‘ 
. ve . ; : 
ee ° ad 
: . . { ® R , / 
; t . ° e \f . 
oes t - 
‘ - , : ) 
i » be 4} ‘ ” 
vy Wk cas ’ . : . ” : 3 ° : re, . TaN 
wR o <é ‘ : ‘ ~ nee 
od ‘ ‘ ‘ rr Se ae 
“Aare oy aos Doge on oe bees ea a I Qe ca a ylenitas 9 
ae 
PEE al a ; : : ost eos: Svan rasa “tna? beth lt 


o _t 7 


; GENERAL DERE TPONS T0 EVALUATORS an 


| . ‘. & 


i 


The Following pages proyide some guidelines for individuals partici- 


oe in the evaluation iin Sex concerns are addressed. . 
: f . 7 NN 
A For Self- She ASSL oe - 
iy 2 ae i. pues student, foremost in mind. re eee Meee 
r “a ae : . . : a ) ee a ed ek eee - eae a 
ei, Assess the criteria from the perspective pf: _ 6 ee 0. 
mers A. _ Students! ratio of currently enrolled students wil] be Ra pga one 
«oon; interviewed. Recommend final group meeting with studénts © oo. 
pie Wf possible: a ee re Coe: ort ah 2 a. 
_. . B. Individual community employers including advisory committee — , 
y members, should be interviewed. 
Il]. Judge criteria on the basis of known acceptable alternatiyes - \. 
mY Av pit . ; 7 . S, 
byt ee 3 wits 
ee es A. Keep in mind that. there is more than one'way to reach ~* . 
ae an objective. i a a a ae 
Pee | 2 w 
- B. Ask yourself if the method stressed is successful. 
IV. Base conclusions and recommendations on facts. 
\ 
A. To accomplish this Objective, documentation ,instruments 
needed are: a : 
Follow- up questionnaire and final weport (past year). 
Fal -Votational program description. . 
‘ 3.  kocal program plan includina Vocational Education —— +. 
. philosophy and goals. . . 7 tees deep 
4. Job. descriptions of: , ; — 
_a. teachers ; 
'b. department heads‘ oo. . 
, C2 vofatiorial director | = * Co 
' d.  cgunselors | sO ee 
5, Calendar of in-service plan eon the year. a a ee 
6 Minutts of Advisory Committee (last two; also, current 
a membership of Advisory Committee if different from Vist . a 
ir ‘ in Plan of Service). ae 
Reale 7. Clas& schedule with enrollemnt. . 
Yee _ : , , ae 
he es ay ' List facts supporting each conclusion. » + 
ne wed. . * j ; 
y at? ; . : , % , ‘ \ y 
tae 4 f 7 caution to ‘be noted here would be to limit conmments to 
oh sam program elements/functions avoiding reference to personalities. 
een Bas” 
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A.. Conduct meeting of evaluators to discuss/combine ratings on 
criteria afd to determine joint recommendations . 


‘ 


Present the date in succinct and tactful form to support conclu: . 


Sions and recormendations as provided” in the aral and written 
pre esentat ions, 


A. Check each recommendation to be sure there is a conclusion 
_ to supportit. 


B. Check that conclusions aré based on iets. 
C. Be sure to. cover strengths as well as areas of Need . eel 
D. - Consider the other person's PENNS: when developing ergict ns. 
. For Third- -Party Evaluators: _ . 

Keep the Student Foremost in Mind. 


A. Put yourself inthe place of the Students with the objective 
of their preparedness for future “educa tyion and/or employment. 


1. Interview sttdents selected at random who are currently 
enrolled in each of the program areas. 


Particularly discussina: 
a. sequencing of cgurses; “i 
b. content and lentth of courses (personal use, 


vocational and general education); 


c. testing and placement services; and, 
d. future planning. : : 
a e ‘ a 
B. Examine follow-up data. : De 
Ps . “ _ 
Assess the criteria from the persbecrive of: 2 % | f 


A. Administration - ANI sci aneeeatoes directly related to the 
vocational education program will be interviewed : 


. 
. . “ id 


Q I. Superintendent . ee 8 . 

Ae 2.~ Assistant Superjntendent eo ; 
ee 3.. Vocational Education Director ; 
oa “ 4. Principal 

Bi " 5. Department Head : ; 
woe ; oe _— 
wg : 
ha oy 2 
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BL Ins tructional,Staff - 2 | a 
aR 1. AN weneiout lucatiun eucs wall be interviewed, m 
Poe “Ge 2a. * 2. Some oe ee teachers will] be interviewed. 
ae . 
"+ Cy Evaluate, do not advise: 
Bi. a. _* Recommend interviews be conducted by two-member teams. nee 


FAI. Judge criteria on the basis of known acceptable alternatives. 


% : : ; . = ; , ‘ ve 
yn ke A. The team should discuss acceptable methods of achieving and 4 eee 
oe. rating that criteria. ; Ee te 
rh Son fs oie ; ; ; F wt 
“<.'IV. Base conclusions &hd recommendations on FACTS... ; 

' . a a a Re ee a a — 


V. Assimilate the data on each criteria, supporting each objective 


ah to reach program conclusions and recommendations -_ <A ae 
Me , . : é 3 . y 
na, A. The team will meet to review all factors first. es 
B. Record as quickly as possible the data required at each- ne 
interviewing Session. Recommend use of tape recorders. 
; | C. -Interview in groups of no_ less than two (2).. * 33 
D. Team members will meet together for lunch.’each day of the a 
evaluation in order to maintain organization patterns. - 
E. Team will meet each evening to organize day's report data 
~ and.to outline activities of the next day. 
; F. Oral report will be made on final day of evaluation.: Indi- + ea 
" _ vidual circumstances will dictate procedure for report. tes ue a 
F. Team leader responsibility: written report will be made ao 
: ' within’seven (7) days of the completion of the evaluation. — ta 
: : “ _« , Low v4 Ce ‘ 
VI. Present the data {p-succinct and tactful form to support con- My 
clusions and recommendations as provided in the oral and. written aa 
presentations. : a 
A. The team should develop wording covering strengths and areas 
° of needs, for oral presentation and summary. 
B. Keep oral report organized and around twenty (20) minutes in a 
~ Jength. ; ee ye - . 
/ wy a ih 
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WC. Be sure written report is mailed to the schooT involved within . 
4 ~ fourteen (14) days. oo ¢ ; 


D. Refer to jndevinliat by title not by name -- oral 
Wrillen report specttie individual. 


Ld { . ry a * : . 
E. Oral and written reports should be compatible. \ 
~s . - , ty 
oa Many of the ‘quidelines: are directed at loeal self-evaluators only, ae: 
- Some are meant for both local self-evaluators and third -party evaluatgrs. SE 
w» Others are indicated as “Additional for Third-Party ERAS: only. = a 
Pare ey 3 ; ee |S ae es 
J . , : ; ; 7 
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¥ 
‘s i. a P 
ee 
« : ag spe 
- ates 
; ae 
: s ' rae Ad 
F ‘ 
Sree 
’ 4 a « : hoe on 
on 
8 
: , ae tg oe 
‘ ‘ em l l- . bet 
‘ vd : a? . ‘te 


ee ' ? . ica 5 : : 
Saale se natal + cana re See OTS | hata. ra rel aa Lota ed er a rr ers nnn 


HOW TO RATE THF CRITERIA | i. 
ie _ . . 
The evaluation instrument follows, Tt consists af sixteen (16) ~ 
; “er iteria organized into four (4) cateyories: : 


. Personnel” 2S Sx aan a 
. Support Resources , ee 
. Management , \ 2 i 
SUE Scunt ee or 
ween The qesomnenaed procedure for rating each of the criteria includes - i nies 
these s aide ey “°: =. ; oy a 
» |. Read over the philosophy statement. -- 2» * 7 pt 
Assess indicators. #2 7 : a 
a. ‘Circle the puma On the rating scale opposite each indicator . 
a that best represents the level of implementation, ‘ 
“Nb. Circle "N.A" only where the indicator is judged to be "not . | ot 
, ve eee es : 
c. Omit rating of any indicators "not observed" of if "no opinion" . 
S Identify additional indicators, if any. _ ; 
With the variety of possible indicators, not all could be. listed 
in the instrument. Therefore space is provided to identify | . 
additional Inevearors and local compensating factors. 7 
3 
Rate the criteria. : ~ mz 
“ee , ‘ 
The last step on each criteria is completing a sutmary statement a8 
i that constitutes the over-all rating of that criteria. These ats 
Ag summary statements may also be useful in completing the report a 
Saye’. section. P | . _ ie 
3 é . . * oo ¥.. 
a Loo ‘3 te 
Bue : . 
ae ¥ ‘ - ‘ 4 ‘ 

“dD 7 a : . Se ate 
a CO a : i er 
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PERSONNEL 


Instructional Staff 


.Guidance and Counseling Staff 


Administrative Staff 


e @ 
- @ 

, 
Polo, sy e. Ge 


; es CRITERIA. VPP ONY netene faa Stall 
. . : a” 
Pha Pasig: Pere) hired) jes bine ahead < Onpebeme des foomeet the 
- vocational education program goals, ; 
a ¢ 2 TnpTemen ted op, 
s Indicators . Fudly | Partially |. Not. ONAL FT 
1. Teachers have ac ademic credit, lh 2 3 4 4 o- NA. 
in-seryice training or work ex- 
perience in the area in which they 
are teaching. 
r | 
‘+ 2.) Teachers. use a variety of teaching ; 1 3 32 4 § 6 NA. 
methods and techniques. | 
J. Teachers are involved'in profes- _ “ } 2? 3 4 5 6 N.A., > 
Sional growth activities to’ improve Soy 
"and/or, learn new skills. - a ; 
“4. Consultants and/or resource persons ° 1} 2 3 4 5 6 N.A. 
Se 4 are used for classroom imstruction., aan "4 


a 


Additional Indich tors Add here other indicators not included above that" this 


educational agency does that contributes to fulfilling 
the philosophy of ‘this criteria. 
i - . 4 
sy : Pg : # 


i) 


oon ae ep ~ he 
‘Summary Statement. Enter here a summary statement support’ing the over-all 
; , rating -given to'this criteria, 


! \ of < 
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’ 
CRITERIA PERSOMNEL . Gurtdanee and Coune] Ing Staff ; 


Phi Tosaphy The quitdanee counse bor and Vac abronab teachers will cooperate 
to assist each studént in choosing ggals and objectives con- 
sistent with Interests and abilities in vocatiohal. education. 


—— = TnpVemented 


Ty DL Partially “DP Not {va | 


Indie ators 


]. The schaol has a designated career an 1} 2 3 4°5 6 Nef. | 
counstling pgdgram, — ‘. af 
2> There is a career testing program 1 2 3 4 45 & N.A 
in the school. - 
3.0 The philosophy and objectives -of ; Le? 3 A@ & G N.A. 
the guidance and counseling are ° 
written-and on file. a 
4. There is an organized procedure 1 2 3-4 15 6..° NA, 
to assist students in- career ; 
. selection and we ' . ; a 
5. The organized counséling ajd 1} 2 3 4 5 6 ~_NLAL. 
guidance services are regiilly ; fle _ 3 
available, to students. 1 . an ~. &.8, 4 . 
_ 6. dob market information and place- 1 2 3 4-56 NAA. 
ment opportunities’ are available , = 
to students. as 
7. Counselors isl creaelees are active 1 2 3 $4 9 6 N.A. 
in placement’ efforts: 4 ee ; 
8. Students are introduced to existing . 1 2 3 4 65: 6 N.A. 
placement services. : . = . : 7 
9. Provisions are made for counseling 1.322 3 4 5 6 N- A. 


the disadvantaged and handicapped. \ 


x 


\ 


Add here other indicators ‘not included above that this 
educational agency does that contributes ta fulfilling 
the philosophy of this criteria. 


Additional Indicators.’ 
Additional Indicators 


er 


? . ° 


punmary Statement. Enter here a summary statement reflecting the over-a}] 


rating given to this criteria. 


: %, 


eee | 


ee 


CREELREA: | PERUONNEL Administrative Stati 


Uli ai) Hier trie Das Jel funelrem ot the adits tealive stall showtd 
effectively facilitate the objectives of the vocational educa-. 
tion program, ( » : 


_ Implemented 
Indicators . fully [Partially |- Not {NAL I. 
‘ 


“1. Person(s) is (are) identified and 1 2 3 4 5 6 NA 


agiven the authority and respon- 
sibility to administer the program. 


Cc. Time ts set aside tor Persons to a l ? 3. 4 yh 6 N.A. 
administer the program, . i iss ‘ 

Ns : 

3. The school administration can show 1 2 3 4 § 6 °- NA. 


evidence of utilizing the Advisory 
Conmitteg for the RMD OSES that it. 
+ is desidned.. . 


* , 


4. Decision-making is based upon a 1 2:3 4 5 6° NA. 


needs assessment of school and 
community ‘sources. 


mn 
a 


Professional development opportuni- i: 2 3 4 § 6 . NAL: 

. ties are provided .for educators. - 

6. “Staff support ‘responsibilities and 1 2 3 4 5 6 . N.A. 
‘duties are provided in written 

guidelines. 


7. Administrators provide "3 ee | 2'3 4 5 6 N.A. °# 
- leadership and resources to foster 3 
the development and implementation 
of the program. 


8, There aré documented short and long- 1 2 3.4 5 6 NA. 
range-plans. - . \ 


- 


~~. 


Additional Indicators. Add here other indicators not included above that this 
educational agency does that contributes ae fulfilling 
the philosophy of thi criteria. . 


Summary Statement. Enter herg@ a summary statement reflecting the. over- -all 
pang warven to this criteria. 


The Crcteria 


- 


SUPPORT SERVICES 


Adveésory Committees 
Financing 


In-School Resources 


a 


CRITERIA 4 


2 


IPPORT SERVICES . Advisory Committees 


Phiiosophy - Advisory Commitlees, composed of representatives of different 


oecupat rons ia the Soi should assist mn develuping ane 
upgrading proarans and should lend support to the vocational , 
education program, 


Z, 


. ™ : vey tiem —— 
Indicators F bully} Partially J Not f NA, 
1. ‘There is a functioning Advisory. 1 2 es 4 5 6 “NA, 
Committee. — : . 

2. -The Conmittee meets regularly with. , ] 2! 3 4 5 6 N.A. 
‘a planned agenda. 9 
J. The-Commiftee is composed of repre- 4 ] eo 3 As. 4 6 N-A. 
sentatives of different occupations 
\ TA the community. 
4. The duties and responsibidi ties - 4 “ 7 2 3 -4 5 6. + NLA, 
of the Committee ‘are clearly outlined. ; 7 
9. Instructional staff are represented , } e.3 4 5 6 N.A. 
_ at Comnittee ineet ings , ; 
6: The majority of the Committee's ] 2 3 4.» 5. 6 N.A 
recommendations are implemented. a 
7. Minutes of thé Conittee meetings . 1} 2 3 4 '5 6 - NLA, 
are distributed to the instructional ce 
staff, ACIS ESA EION; ahd. Conmabvee 
‘members. ? 
8. All Committee representatives, in- . } 2 .3 4 5 6  «o.NLA. 
'Spructors, and school administrators . Ow : 
dre notified in.advance of Committee ° 
meetings. - 


. UTE Orie a TS TCat rs 


Summary Statement. ’ Enter ‘here a summary statement supporting the over-al] 


* ‘ > 1 
a A i 


Add here other indies tors not included aboye that this 
educational agency does that contributes to a 
the philosophy of this. criteria, 


rating given to-this criteria. 
. & 


CRITERIA: SUPPORT SERVICES 0 4 ents 


Phi losaphy Funding resources should be adequate to carry out oan effective 
- wucgliuial mlucalion program as delined im the Short- and Long- 
Range Plan of the school district. 
p : 


i "etal Pe 


Indicators Fullyf oo Partially J Not Po NAL 
‘1. Vocationat teachers work. together . } 2 3 4 5 6 N.A. 
to develop a budget. ; 
2, The teachers and administration work °° YY 2? 3 4 5 6 NA. 
o ae tce in developing a program : : 
buddet. = . 
3. fhe resources for the program are : -1 2 3 4 5 6 NLA 
adequate for short- and long range ~ “a 
plans. : ey ; 
4: . Funds are available for teachers. to - 7 2 3 4 2 5 6 N. AL 


attand professional meetings, con- 
ferences and workshops. * 


§. Financial resources are adequate for 1 2 3.4. 5 6 NA. 
" in-service and curriculum development. : 


6.. Finapctal resources are adequate for - 1 2 3 4 5. 6 NLA... 
the purchase of program instructional 
materials and supplies.’ 7 


7, The s@hool district’ is ‘aware of and_ 1 2 3 4 5 6 NLA. 
able to explore all sources of dif- = ; 
ferent pragram funding , 


8. Funds are available for extende@ cbn- tk 2s 
tracts when needed. (Youth. group 
advisors, summer Progrels etc.) 


Additional’ Indicators. Add here other. indicators not included above that this. 
‘ educational agency does that contributes to fulfilling 
the priitesophy of this criteria. — 


a 
‘ aa 
{ — - 
Summary, Statement. Enter here a. summary statement supporting the over-all] 
x paling given to this criterfa. 
~~ y 
q ° i 
x \ 
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SORITERIA: SUPPORT SERVICES Tn School Resources 


Philosophy 8A learning environment (equipment , facilities and instruc trom! 


materials} through diverée activities Should provide students. 
_ With ai opporlunily, Lo develop competencies as preeeiibed, in 
i vocational education program objectives. 
. : co aie Imp cen ted Ps as 
Indicators huivy] Partially [Not [NAL 
1. A reterence library or resource center 1 23 4 5 6 N.A. 
is provided. 
2.. Adequate space is provided for visual ° 123 4 5 6 N.A 
\ s- * board and tackboard, 
3. There is a ma#ntenance and replacement + | 1 2 3 4 4 6 N.A. 
program for equipment. 
‘4. Good repair records are ‘kept. -1 23.4 5 6 NA. 
5. There are adequate storage facilities. 1 2-3 4 5 6 N.A. 
6. There is suffiedent: square: a 1 23 4 5 6° NA, 
. per Student. s : 
o r ‘ 
7, A lab ared is provided. _ ; — . 1 23 4 5 6 N.A, 


a 


8. Teacher work areas are provided. 


9. Teachers are involved in new facility 1 23 4 5 6 N.A. 
planning and/or remodé1 ing. 
10. Teachers assist in equipment selection. -* 1 2 3 4 5 6 NA, 
11. There is a periodic inventory system. "1 2°34 °5 6 NA. 
12. Adequate electrical outlets and: master | 2-3 4 5 6 - NLA. 
; switches are eee ee , 
‘13, Machine noise level is suppressed by the 1 2°34 5 6 NA, 
use of sound broofing. P . : 
14, There is adequate heating, ecsitna venti - “1 23 4 5 6- NAA, 
Heed On and egnt ing systems. *’ j 
15. Advisory Committee members assist in 1 2 3 4 5 6 NA 


equipment selection. 


16. Students aréable- "A use equipment during 1 23 4 5 6 N.A. 
periods other than when they take classes, - 


17, Sink areas are available where needed, 1 234 56 NAA, 


18. Program_faci tities reflect a clean 1 23 4 § 6 N.A. 
and orderly learning environment. ‘ ; 


19. Sufficient quantities of up-to-date , 1 234 56° NA; 


well-maintained tools and equipment’ - -# 
are available. : 


- ) . : | | , -20- . | : 
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CREIERTA CSPPPORT SEPYECES Tne Se hood Resour es 


Teer re a ca any Ane reo 


ee ees Soe ee as oe eee ee et ge 


Summary Statement. 


Additional Indicators. 


Ada here ofKer indicators init inevnded on the previous 
page that this educational agency. does that contributes 
to fulfilling the philosophy of this criteria. 


‘ 


. eee = a a 
a 


te ee ee ee ee te ee ee ee 


Enter here a summary statement supporting the over-all 
rating given to this criteria. 


a 


us 


\s 


MANAGEMENT 


‘Fvaluation 
Placement 
Planning Systems 


Public Relations 


< 
Cr 


GCREIERTA:: MAL AGEMENE © Evaluation 


ithe ayy Prag evaluation qs a coml indus 245 letialiy pretuss to provide 
data for planning, decision-making and determining the level of 
attainment. ; 


; 7 ~— TinpTemented ~~ i. 
Indicators | ayy | Partially — [net NAL 
1. Continuous evaluation 7s conducted. ] 2 3.4 5 | 6 N.A. 


to determine if student learning 
experiences are relevant. 


°. The evaluation wrocess allows a variety ] 2° 3. 4 5 6 N.A, 
Of qroups to express their opinions. 

- . a . ~ ; ; s 

3. Evaluation includes employers' reports +t 2 34 5 6 N-A. 

on students enrolled in work- related / 
programs., ° Sy a 

4, Evaluatiod, procedures are periodically 1 2 3 4.5, 6 NLA, 

- reviewed. : 

5, There’ is evidence that recommendations 1,2 3 4 5 6 N.A. 
from evaluations are implemented, 

. 


i pa ra ea 


Additional Indicators. Add here other’ indicators not included above that this 
. educational’ agency does that contrittes to fulfilling 
- the philosophy of this’ criteria, r 


o 


Summary Statement. Enter here a sumiary statement panpernid the over- -all 
rating given to this criteria, 


{ 


t} -“/ ju 


GRIETERITA > MANAGEMENT - Placement 


Pha bosaphy Provindans should be made to assist students in identafying 
placement service ae feb, ane ietent wilh 
~their vocational teal : 


_ elemental Wess ee 
Indicators hay. [. bate aL Not | NLA, 
© 7. Provisions ape made to instruct |"? 2 4 & & NLA, 
Students in procedureof seeking , : 
and applying for a job. - . ; 
2. Provisions are made to assist students 1 2 3.4 5 6 ‘NLA. 


in utilizing advanced educational 
Services. 


3. Provisions are made to assist students } 2 3 4 5 6 NLA, 
* in identifying employment consistent 
with their vocational training. 


4, Provisions’ are made to assist students ] 2 3 4 5 6. N.A, 
in utilizing job placement services. 


Add here other indicators not included above that this 


a Auditional Indicators. 
educational agency does that contributes to fulfilling 
ate the philosophy of this criteria. 
a 
Bhmary Statement. , Enter here a summary statement supporting the over-all 
_ vating given to this criteria. 
\ 


Qo. . a : =24-.* e : ‘ . e 
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CRI Rik. SAGES A Phameing oys fens 


Phi basophy The implementation af Short and bong Range Planning 1s essential 
to assure that a vocational education program effectively meets 
student and community needs, 


pee me red ee ts 
Indicators Tully To Partially “Phot p Nea. 
1, An on-going needs assessment I 2 2 4 & | NLA, 
procedure is present. 
2. A follow-up procedure has been } 2 3 4 § 6 N.A. 
implemented. . 
3. Planning is based upon an analysis ] 2 3 4 45 6 NA. 
of program cost-effectiveness. , : 
4. Program planning and revision is } 2 3 4 § 6. NLA. 


based upon current job/labor demands 
and projections. 


5S. The planning process provides for. 1} 2 3 4 5 6 N.A, 
the development ‘of new prograis 

and the elimination of out-dated 

ones. 


6. The planning process allows a var- 1 2 3 4 5 6 N.A. 
jety of qroup participation, 


Additional Indicators. Add here other indicators not included above that this 
| educational agency does that contributes to fulfilling 


H- . the philosophy of this criteria. 


~ ' 


Enter here a sunmary statement supporting the over-all 
rating given to this criteria. \ 


Summary Statement. 


CRETERDA: MANAGEMENT Public Pelations 


Philosephy bf fective community support is necessary to commuinreate. the 
value and objectives for the SOnInUaLIOn and growth of the 


2 vocational education proqram. 
Oey 
: ae ry ie oe ot ao ae ie pees 
ee, eke | 
Indicators “rinty TU Partially J] Net [NAL 
1, Communication exists between the 1} 2: 3 4 5 6 NLA. 
program and the community.. . . 
2. There is a formalized public relations 1 2 3 4 5 6 NvA. 
program. . 
3. Community resources are used effectively i 2¢«¢at 4+ & © N.A, 
to supplement the program (i.e., RSVP, 
Co-op, on-site, field trips, guest 
speakers, etc.). * | 
‘4. A person is deeqonat ed and responsible . J 2 3 4 5 6 N.A. 
_ for the vocational education public 
relations program. 
5. The programs perform community service 1 2 3 4 5 6 NLA. 


projects. 


eT ee A ae a ae ee 
Additional Indicators. Add here other indicators not included above that this 
educational agency does that contributes to fulfiJling 
the philosophy of this criteria. 


Enter here a summary statement supporting the over-all 
rating given to this criteria. 


summary Statement. 


\ 


; ‘ Delivery Strategies 
In-Service 
Needs of Special Students 


Student Leadership- Development 


sy 


CURRICULUM. « 
; Articulation 

Cooperative Education/Work. Experience 7 
| , 
| 
| 
! 
| 
! 
| 
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CRITERIA  CHUPRICUEUM © Articulation 


at lonoaphy The voeational education curriculum should be sts aie ania 
cuurdittaled ly Complement: and factlitate students’ educational 
and occupational goaJs. 


\ 
oe glmpTemented 
Indicators hy To Partiany | Not PONIA, | 
- Ihere is a philosophy or program goal } 2 3 4 5 6 NLA, 
for articulation written for the agency. » at 
_?. There is a written scope and sequence ~ 1 2? °3 4 #5 6 NLA. 
for each program of study in the agency. 
3. The program provides avenues that permit ] 7? 3 4 5 6 “NLA 


students to move from high school to 
post-secondary programs with advanced 
placement granted ‘through equivalency 
and/or proficiency evaluations. 


P 4. High school students have the opportunity bo 2 3 4 #5. 6 N.A. 
to take-post-secondary vocational courses 
while finishing high school. 


5. Student outcomes and performance objec- } 2 3 4 5 6 N.A. 
tives are written for the curriculum ° 
f .. of each vocational program area. 


6. Exploratory work programs are available } 2-3 4. 5 6 N.A.- 
in the curriculum td assist in career 
choices. ‘ 


7, Students are exposed to career clusters 1 °2 3 4 5 6 NA. 
-. early in the program. 


eo" 


Additional Indicators. Add here other indicators not included above that this 
educational agency does that contributes to fulfilling 
the philosophy of this criteria. - 


na, — 


Enter here a summar 


tement supporting the over-all 
rating given to t 


Summary Statement. 
S criteria. 
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CRITERTA Cave TOM fhapeyatrve ddgecatlion7 Werk | Apen Dene 


Philosophy The vonational oon the fob tragnming program shad provide a 
practical work emperienes program based upon individual. student: 


. needs. 
_ Imp event 
Indicators, ; “puny Lo Parthally Po Not TONAL 
|}. There is an on-going system to assess + 1 2 9 4 5 6 
i student needs in terms of: Le 
a. Work stations related to ‘student / » . 
training objectives, 
b. Job description/training plans, 
c. A File is maintained of community 1 2 3 4 5 6 N.A 
training resources. P 
we 3... There are written guidel ines for: 1 2 .3 4 5 6 N.A. 


a. Student placement ; _ 3s 
b. Training Agreements , 4 
c. RSVP or other work-related program s . 

d. Granting credits. ° 


4. A qualifted work experience ‘coordinator 1 2 3.4 5 6 N.A. 
is identified. | _ 
5. Time is set aside for coordination . 1} 2 3 4 5 6  N.A.. 


of work experience. 


- Indicators. Add here other indicators not included above that this 
educational agency does that contributes to. fulfilling 
the philosophy of ‘this criteria, 


» 
+ Sumiry Statement: _ Enter.-here a summary | statement support ing the over-all 
rating given to this criteria. 
e e 
~ 3 < Pa \ 
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CREIPERTAS  CURRTCUEERN Delivery Strateqies 


Phi tavcenahy Delivery systems should be approprdate to the needs of students. 
"and to the type of patertal being presented; varieties of approaches 
should be encourag@d to help meee students and increase quality 
“and quantity of Jearning. 
\ 


: Ty Teme ie “d 
Indicators. _ Fully oy he ba { Aw ly ia Not 


‘1. Methods of instruction are flexible 1 2 .39 4 5° 
enough to meet individual student 
“ am needs. 1 
2. Audio-visual materials are uttlized ] ? 3 4 .) 6 NLA, 


as either th® basic or supplementary 
method of instruction. 


a 3. Where facilities are.limited, provi- 1 2 3 4 5 6 |-NLA. 
sions are made for use of existing 
facilities/programs available in the 
communi ty or other educational agencies. 


4, The-laboratory method is incorporated 1} 2 3 4 5 6 N.A. 
where students may apply learning. 
5. The simulation method is available to 1} 2 3 4 5 6 N.A. 


‘ students as either a final preparation 
, for or where necessary in lieu of actual 
on-the-job experiences. 


6. Where local work experience. opportunities 1 2.3 4 5 6 N.A,. 
are. limited, advantage is taken of the a8 
fi RSVP Program. . ‘ 
7. Self-contained transportable instruc- 1 2 3 4 5 6 N.A. 


tional programs are including tools, 

equipment and instructional materials w 
Gtilized on a share basis through 

central office, resource center, sta 2 ) 

library, -etc. 


‘e 8. The contract method‘is used to indivi- - 1°2 3 4 5 6 N.A, 
dualize.and monitor student learning, = \ 


9. An alternative school sega option 1 2. 2 -@ 6% 6 N.A. 
is available to students having 
difficulty ‘succeeding in the regular ; * 
program. 


10. Student leadership organiza-  -- - rr 2 3 4 5 £6 N;A. 
tions are an integral part of the 
-« instructional approach. 


- oe | . 30. a, | 
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CREEPRTA®  COURPTCHEUM Delivery Stratedies : 


te en me aa re vanes eee sree renames adhe mate cons en enter ee gee a ee ee eee ee ee 


Additional Indicators. Add here other indicators not included on the previous 
paqe that this educational aqency ddes that contributes 
to fulfdTling the philosophy of this criteria. 


Sunmary Statement. Enter here a summary statement supporting’ the over-all 


rating given to this criteria. 


* 
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CRITERIA:  CHRRECIN IM In: Servier 


ha losophy - The knowledge and skalds of the imetructional staff directly 
affect the quality of the educational program. Sehoal boards 
and adleinisti at pon ape Pespyns ib ld elaes uidersluanding the LUNIA 
petencies needed by the staff to operate an effective vocational] 
education program and ny retin in-service opportunities. 


‘ an Implemented —° OP 0 
Ludivators bully | Partially | Not NA. 
1. On-going in-service programs .are a ] 2 3 4 5 6 NLA, 
established. , 


a 


NLA, 


eal 
Dn 


2. Teachers are involved in planning the | (a ae | 
‘ In-service activities., ¢ 


3. Provisions in the way of time and. 1! 2 3 4. 5 6 N.A. 
. finances are made for the staf¥ to ; ; 
attend state and professional ' 
organization-sponsered in-service 
conferences or workshops. 


4. Provisions are made for appropriate 1 2 3 4 5 6 N.A, 
‘ consultant assistance, : ; 


5. Financial resources are adequate for | 1 2 37 4 5 6 N.A. 
+" in-service and curricdlum development. 


6.. Administration provides release time } 2 3 4 §5§ 6 N.A. 
and resources for professional purposes 
and growth. 

]. In-service activities are provided ] 2 3.4. 5 6 NA, 
for the support staff. 


YY 
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Se ne ec a 
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Additional Indicators. Add here other indicators not included above that this 
educational agency does that contributes to fulfilling 
the philosophy ofthis criteria. 


‘ 


Enter here. a summary statement supporting the over-all 
rating given to this criteria. 
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| Additional Indicators. 
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RITERIA. CURR E CUE TIM 


hi locaphy 


Needs at Special Students 


provide fur edugalion and teaming of the handicapped and 


disadvantaged. 


ndicatoars 


iz 
access to programs. 
é. 
Be 
of handicapped students: to a 
tional. programs. 
4. 


All categories of students have 


Tutorial services are available. 


Tn 
| Fully [oI 


Provistons ‘are made. for transportation 
1] voca- 


Maximum provisions for participation 


of handicapped. students with regular 


students are made. 


Sunma r Statement. 


2 


Add’ here other indicators not included above'that this 
educational agency does that contributes to fulfilling 
the philosophy of this criteria. 


en ag ee 


Enter here a summary statement su 
rating given to this criteria. 


~ 


1 


(. 


e 
. 


2 


ementod 


3 4 
3 4 
34 

4 


pporting the over-all 


— 


4 


Programs should recognive the special needs of studemts and 


Provision should be made to insure that programs 
and materials are racially and sexually bias free. 


pra} 

5 6, NA 
5 6 N.A. 

ty NLA, 

> 6 


NAL 
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CRITERIA CURRICULUM - Student Leadership Development 


Philosophy - Student leadership training should be an inteqral part of the 
tistyucttenal program to develup |ecadurship qualplies . bly vugh 
_ participation in-school and community activities. 


fo TimpTemented cael 
4 “NAL 


4 


Indicators Fully [> Partially | Not” 

1.” Related student leadership grgan- ] 2 3 4 5 6 N.A. 
izations aré available to van 4." 
students. ' 

rae Deve lopment of youth ieadorship 7 2 3 4 5 6 «; NA, 
competencies [s an integral part of ~ 
the instructional program. 

3. Records of the activities of {ocal 1} 2.3 4 5 6 . NAA 
organizations are maintained. DN ) 

4, Funding is available to support these ‘ } 2 3 4 5 6 NAL 

“activities. 

5. Students attend local and state. 7 2 3 4 5 6 NA, 
conferences. 

6. There are staff identified to super- 41 2 430 4 5 6 ON 
vise the activities of the student yes 
organizations. . ‘2 a 

. ye . : 
f 


Additional Indicators. Add here other indicators not included above that this 
‘educational agency does that contwibutes to ‘fulfilling 
the philosophy Srey te criteria. 
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Summary Statement. Enter here a summary statement supporting the over-all 
- rating given to this criteria. 
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P Cumulative,Report 


This report section is a culmination of al] the ef- 
forts that have been made in conducting the evalua- 
tion of the vocational education program. To this 
point, the instrument provided the criteria with 
Suggested indicators to assist: ip an approach of 
“seek and verify." Additionally, you may have 
added "Additional Indicators" which document meth- 
ods your program uses to meet the elements of a 
criteria. 


és : a” 
The findings (summary statements prepared for each 
criteria) along with recommendations are now organ- 
ized and displayed for both communication and 


' planning purposes. 


Review the General Directions to Evaluators in the 
front of this booklet. for important things to keep 
in mind when preparing the report. 


This evaluation system is organized around the 4 
component parts of the total program. The 

intent of the system 46 to contribute one 

part of an over-all system of planning, ev~ 
atuation and accountabiltty Of program of fer- 

4ngs within the Local education agency <n onder 

fo Umporve programs provided to students. 


‘<) 


~ 
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IT. Conc lusions-Strengths 


of this vocational educational program 
. 7 . 


5 ‘ 
é — 
ee 
™ . ; \. 


Instructions: Review each of the criteria eval- 
uated. List below the activities and/or conditions 
that exist that are to be commended as strengths 


fh 


IIL. Conclusions-Areas for Improvement 


Instructions: Again review each of the criteria 
evaluated. List below th@@® areas identified as 
needing improvement. . These needs wil] then serve 
as the basis for the recommendations which follow. 


~ 


IV. Recommendations 
Instructions: Critically analyze the preceding con- 
clusions on Strengths and Areas for Improvement. For- 
mulate and list below appropriate recommendations. 
There may or may not be recommendations addressing the 
Strengths. However, recommendations should address 
all major Areas for Improvement. A single recommen- 
dation might address more than one conclusion. Also, 
a particular conclusion may suggest more than one‘ 
recommendation. 
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CAREER & VOCATIONAL 
EDUCATION UNIT 


ADDITONAL FACTURS - 


CRETJ RIA 


_ CRITIQUE 


CURRICULUM : 


t.. ; 


INDICATORS 


o 


LOCAL EDUCATION AGENCY 


(LEA) 


MANAGEMENT 


PERSONNEL 


f 


PROGRAM EVALUATION 
TASK FORCE 


Glossary 


A section of the Department of Education within 
the Education Program Support Division with 

the responsibility for career and vocational 
education. 


Mechanisms that develop strength in terms ot 
the criteria/philosophy by which the program 
seeks to make up for inadequate traditional 
indicators. . 


Accepted standards by which a program can be 
evajuated. Criteria are expressed “in the in- 
strument as a brief philosophy statement. 
Sometimes referred to as criteria/philosophy 
for the purposes of this instrument. 


The survey being used to gather input from 
users or potential users in the form of 

a critical analysis of a) the criteria, 
and b) the self-evaluation format. 


One of the four categories of criteria in 
the instrument regarding articulation, 
cooperative education/work experience, 
delivery strategies, inservice, scope and 
sequence, and needs of special students. | 


Activities, provisions, or other items that 
are recognized as tangible evidence indi- 
Cating status of a criteria/philosophy. 


An administrative unit responsible for delivery 
of educational programs at the local level 
such as a school district or community college. 


One of the four categories of criteria in the 
instrument regarding administrative, 
instructional, guidance and counseling, 

and support staff. 


One of the four categories of criteria in the 
instrument regarding administrative, instruc- 
tional, guidance and counseling, and support 
staff. - 


A representative group of educators concerned 
with vocational education convened for the pur- 
pose of designing, testing, and revising = 
vocational education evaluative criteria. 

These crjteria would be taken by the Career 

& Vocational Education Unit and formated for 
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PROGRAM REVIEWS 


% 


PROMISING PRACTICES 


SELF-EVALUATION 
SUPPORT RESOURCES 


THIRD-PARTY REVIEW 


VOCATIONAL STUDENT 
LEADERSHIP ORGANIZATIONS 


- STATE PLAN FOR 


VOCATIONAL EDUCATION 


- SUPPORT STAFF 


S.P.A.N. 


The ren pipes: ef auld vvadualin, 
program reviews, and promising practices. 


The activity conducted by the Career & Voces - 
ational Education Unit that goes beyond the 
compliance review and takes an indepth look 
al the vocational program tor the purpose of 
program improvement. 


That activity of the DOE Program Development 
and Dissemination Unit whereby exemplary pro- 
grams are nominated, validated, written up 
and disseminated. 


A review initiated by an agency of its own 
program to determine areas of need for program 
improvement purposes. a 


One of the four categories of criteria in the 
instrument regarding advisory committees, 
finances, and in-school resources. 


The process through which a self-evaluation 

is validated. This usually involves an on- 

site visitation by an outside team providing 4 
an external view of the vocational program 

as well as suggestions for program improvement. 


A method of instruction considered an integral 
part of the vocational curriculum that pro-. ; 
vides learning otherwise often ndt delivered. 

Leadership development is emphasized along ° 
with civic awareness through professional 

conferences, local chapter activities, school 

improvement a and support of community 
activities. 


A five year plan, devised by vocatiohal education 
in the-state of Alaska to give direction to dev- 
elopmental activities. . 


stants to instruc- 


Usually non-certificated 
tional or supervisory 
ectly or indirectly 
process. A 


d the instructional 
Systematic planning around needs, an.Alaska- 
Department of Education plan to provide an 


organized approach to a comprehensive. ‘ : 
service delivery system. 
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THIRD PARTY 
ae 


REVIEWS 


- ; 
Ihe method by which an aqency has an out- 
side agency or person conducts an evaluation 
or validates an evaluation already conducted. 
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